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Sir 

The Appellant respectfully submits this Reply Brief in response to die Examiner's 
Answer mailed on June 1 1 , 2008, and thus this Reply Brief is timely filed within two months 
of the Examiner's Answer. 



PAGE 2/14 * RCVD AT W1 1/2008 2:50:25 PM [Eastern Daylight Time] * SVR:USPTO€FXRF-507 * DNIS:2738300 « CSID7038655150 * DURATION &nm-ss):02-04 



HUG-11-2008(M0N) 14:02 MflNNHVA & KRN6 ( FRX ) 7038655 1 50 P. 003/014 

PATENT Atty Docket No.: 20020S522»] 

App. Scr.No.: 10/675,944 

TABLE OF CONTENTS 

PAGE 

I. STATUS OP CLAIMS 3 

II, GROUNDS OP REJECTION TO BE REVIEWED ON APPEAL. 4 

ITT. ARGUMENT 5 

A. Claims 1-3 and 23 5 

B. Claims 14 and 15 10 

IV. CONCLUSION . 13 



2 



PAGE 3/14 * RCVD AT 8/1 1/2008 2:50:25 PM [Eastern Daylight Time] * SVR:USPTO-?XRF-5/37 k DNIS:2738300 * CSID:70386551S0 * DURATION (mm^ss):02-04 



RUG-1I-Z008(M0N) H:03 NRNNRVR & KRNG (FRX ) 70386551 50 P.OOd/Olfl 

RECEIVED 

CENTRAL FAX CENTER 

AUG I 1 2008 

PATENT Any Docket No.: 200205522-1 

App. Scr.No.: 10/67S,944 

I. Status of Claims 

Claims 1-12, 14-20, 22, and 23 are pending in the present application. 
Claims 13 and 21 have been canceled. 
Claim 22 is allowed 

Claims 4- 1 2 and 1 6-20 arc objected to but have been indicated as being allowable if 
rewritten to include all of the limitations of the base claim and any intervening claims. 
Claims 1-3, 14, 15, and 23 Stand rejected. 

Pursuant to 37 CF.lt § 41,37, the Appellants hereby appeal the Examiner's decision 
finally rejecting Claims 1-3, 14, 15, and 23 to the Board of Patent Appeals and Interferences. 
Therefore, Claims t-3, 14, 15, and 23 of this application are at issue on this appeal. 
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IL Grounds of Rejection to be Reviewed on Appeal 

Whether Claims 1-3, 14, 15, and 23 should have been rejected under 35 US.C. § 
103(a) as being unpatentable over WO 02/0S9062 to Kimmcl ct al. (hereinafter u Rbimel et 
al.") in view of the disclosure contained in the background section of the present 
Specification (hereinafter "admitted prior art") and further in view of U.S. Patent Application 
Publication No. 2004/0091 164 to Sakabmi et al. (hereinafter "Sakatani et al,"). 

In the Appeal Brief, the Appellant erroneously indicated that the grounds of rejection 
to be reviewed on appeal included review of the "Requirement for Information" under 37 
C.F.R. §1.105 and whether the drawings shoul d have been objected to under 37 C £ JL § 
1 .83(a) for allegedly &il ing to show the features of Claims 14-20 and 22. The Appellant 
therefore withdraws those grounds of rejection from the present appeal. 
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m. Argument 

A, Claims 1 -3_and_23_ 

Kimmel et al Falls to Disclose a Non-Linear Illumination Estimation Module 

The Examiner asserts that "figure 2 of Kimmel shows an iterative estimator 104 that 
estimates illumination using a non-linear max operation as shown on page 3/* This assertion 
is improper and mischaractcrizcs the iterative estimator 104 described in Kimmel ct al. (WO 
02089062). 

In making this argument; the Examiner refers to lines 1 9*27 in page 3 of Kimmel et 
al. That section of Kimmel et al pertains to the background section of the Kimmel et nL 
patent and although Kimmel et al. does not explicitly state that the iterative estimator 104 
docs not perform the described "'reset' non-linearity", there is nothing in that section to 
indicate that the iterative estimator 1 04 performs the "non-linear (max) operation** described 
therein. In fact, it appears that Kimmel et aL seeks to improve upon the approach described 
in that section as evidenced by the discussion on lines 28-3 1 on page 3* 

Instead, Kimmel et al. discusses the iterative estimator 1 04 on lines 1 7-1 9 of page 6 as 
an "image processing module 1 04 [that] uses a Projected Normal Steepest Descent or similar 
algorithm, with multi-resolution processing, to compute an estimate 107 of the illumination, 
designated in Figure 2 as /*.** Thus, there is no clear indication that the image processing 
module 104 estimates illumination using a non-linear max operation as asserted by the 
Examiner. 
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Regardless of the Discrepancy in tlie Rejection, the Examiner has Failed to 
Establish Obviousness of Down-sampling Input Images in Kimmcl et ah 

The Examiner argues that it would have been obvious to replace the linear 
illumination estimation module 30 (depicted in Figure 2 of the present application) with the 
log module 102 and the iterative estimator 104 (depicted in Figure 2 of Kimmcl ct al.)* (Sec 
Examiner's Answer, page 9, lines 1 9-21). There is some discrepancy in this argument 
because the Examiner also argues that the "non-linear estimation device of Kimmcl includes 
log module 102, non-linear module 104, and summer 108 M . (See Examiner's Answer, page 
4, lines 17 and 18). It should be noted that Kimmcl et aL never refers to the iterative 
estimator 104 (or image processing module 104) as a "non-linear module 104" and that, the 
Examiner has named the element 1 04 as such. As discussed above, the Examiner has 
mischaractcrfecd the image processing module 1 04 as using a non-linear max operation* 

Assuming that the Examiner intended to replace the linear illumination estimation 
module 30 with the log module 102, non-linear module 104, and the summer 103 as stated on 
page 4, lines 17 and 18 of the Examiner's Answer, the proposed combination fails to disclose 
the asserted features of Claims 1 and 23* Kimmcl ct ah discusses on page 6, lines 1 9»23, that 
the estimate 1 07 of the illumination is combined with the output 1 03 {s) at summer 1 08 to 
produce an estimate 109 of the reflectance (r*), which "is converted from a logarithm lo its 
corresponding base number value at exponential module 1 10, lo produce a number value as 
an estimate 1 1 1 of the reflectance (designated as R*)" In other words, Kimmel ct al, 
discloses that the summer 1 08 combines the estimate 1 07 of illumination (/*) with an output 
1 03 (s) to produce an estimate 1 09 of the reflectance (r*). As such, the combination 
proposed by the Examiner would result in the input into the up sample module 34 (Figure 2 
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of the present application) comprising the reflectance (r*) and not an interim illumination 
estimation as claimed in Claims 1 and 23 of the present invention. 

Assuming that the Examiner intended to replace the linear illumination estimation 
module 30 with the log module 102 and non-linear module 104, without the summer 108, as 
stated on page 9, lines 19 and 20 of the Examiner's Answer, the Examiner has failed to 
establish that the proposed combination is proper and would yield the present invention as 
claimed in Claims 1 and 23. 

The Examiner asserts that it would have been obvious to down-sample input images 
prior to inputting the input images into the log module 102 of Kimmel ct ol» This assertion is 
improper because the Examiner has foiled to provide any evidence that one of ordinary skill 
would have been motivated to both down-sample images and produce logarithms of the 
down-sampled images. Instead, the Examiner has merely staled that down-sampling is 
desirable as a means for speeding up the computationally intensive Retincx process. 

Sakatani et al fails to make up for the Deficiencies in Kimmel et ai 
Although the Examiner acknowledges that Kimmel et al. fails to disclose an 
upsampling module as claimed in Claims I and 23, the Examiner argues that Sakatani ct al. 
(US 2004/0091 1 64) and the alleged admitted prior art disclose these features. In addition, the 
Examiner argues that the discussion contained on paragraph 118 of Sakatani et al, and on 
page 3 of the present application, disclose "an upsampling module that uses the input image 
as a guide in the interpolation for the benefit of performing Retincx type processing... w . 

Initially, even assuming for the sake of argument that the combination of Kimmel ct 
al., Sakatani et al., and/or the alleged admitted prior art proposed by the Examiner is proper, 
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the proposed combination fiiils to make up for the other deficiencies in Kimmel ct al. 
discussed above. More particularly, for instance, the proposed combination fails to disclose a 
non-linear illumination estimation module that receives sub-sampled images as claimed in 
Claims 1 and 23. 

Secondly, as discussed in the Appeal BricC paragraph 118 of Sakatani et al. recites 
that the resolution of the original and blurred images are matched with each other to execute a 
Single Scale Retincx calculation. More particularly* that paragraph slates that the resolution 
of a blurTed image is changed to match the resolution of an original image by interpolation. 
As such, Sakatani ct al. discloses that the resolutions of images arc mulched with each other 
and thus docs not disclose that interim illumination estimations are interpolated to produce an 
illumination estimation by using an input image as a guide in the interpolation. For at least 
the foregoing reasons, the proposed combination of Kimmel et al. and Sakatani et al. fails to 
disclose all of the features of independent Claims 1 and 23. 

The Examiner's discussion from the alleged admitted prior art regarding "'using the 
high resolution input image S to select corresponding output pixels' when 4 the interpolation 
is performed on a set of smooth, low resolution intermediate images'" pertains to illumination 
manipulation module 20 and not lo the up-sampling module 34. This is clearly evidenced in 
Figure 2, which depicts the high resolution images L" and the high resolution input image S 
being inputted into the illumination manipulation module 20. As such, that cited passage of 
the alleged admitted prior art also fails to disclose an up-sampling module that is configured 
to interpolate interim illumination estimations to produce an illumination estimation by using 
an input image as a guide in the interpolation. 
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The Examiner's response to this argument is that "[t]hc fact that the admitted prior art 
uses the original image as a guide in interpolation performed by the illumination 
manipulation module 20 docs not preclude an engineer of ordinary skill in the art from using 
the original image as a guide in the interpolation performed by the up-sampling module 34, as 
taught by Sakatani in paragraph 1 17.** (Examiner's Answer, page 11, lines 3-7)> This 
response is confusing at best and improper at worst From this response, the Examiner 
apparently agrees that the alleged admitted prior art fails to disclose that the up-sampling 
module 34 performs an interpolation using the original image as a guide, but the Examiner 
still rejects Claims 1 and 23 as if the up-sampling module 34 uses the original image as a 
guide in the interpolation. (See, Examiner's Answer, page 6, lines 12-14). Thus, it is not at 
all clear as to how -the Examiner has interpreted the admitted prior art 

For at least the foregoing reasons, it is respectfully submitted that the proposed 
combination of Kimmcl et aU the admitted prior art, and Sakatani ct «L fails to disclose each 
and every clement claimed in Claims 1-3 and 23 of the present invention. Accordingly, 
assuming only for the sake of argument that one of ordinary skill in the art were somehow 
motivated to combine these disclosures as suggested by the Examiner, the proposed 
combination would fail to disclose all of the features of the claimed invention. Clearly, 
therefore, the proposed combination foils to teach or suggest all of the claimed elements, and 
thus, the Examiner has failed to establish a prima fade case of obviousness based upon these 
documents. 
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B. Claims. 14 and IS 

In the Official Action dated September 4, 2007, in rejecting Claim 14 f the Examiner 
asserted that Kimmcl ct al. discloses ^producing one or more law resolution input images by 
sub-sampling the high resolution input image, generating an interim illumination estimation 
for each of the one or more Jaw input resolution images, and producing a Retmcx corrected 
output" (page 6, lines 1 5-18). As argued in the Appeal Brief, the Examiner failed to identify 
which sections of Kimmcl ct aL the Examiner relied upon in setting forth this rejection and 
thus, this rejection is improper. In response to that argument, the Examiner has stated that 
Xlaims 14 and 15, which have elements similar to apparatus claims 1 and 3 expressed in 
method form, arc rejected for reasons given in the rejection of claims 1-3/* (Examiner's 
Answer, page 11, lines 11-16). 

However, on page 7 S lines S-21, the Examiner has apparendy changed his position by 
withdrawing the assertion that Kimmcl ct al. discloses any of the claimed features in Claim 
14. More particularly, there is nothing in the rejection of Claim 14 that references Kimmel et 
al. and it is not at all understood why Claim 14 was rejected based upon the disclosure 
contained in Kimmcl et at In fact, it appears that the Examiner has modified the rejection of 
Claim 14 to be based solely on alleged admitted prior art and the disclosure contained 
Sakatani et al., thus removing any reliance on Kimmcl ct al. One result of this change is that 
the rejection set forth on page 7 is improper and confusing. 

For instance, if the Examiner is now asserting that the admitted prior art discloses all 
of the features of Claim 14, then it is unclear as to how or why one of ordinary skin in the art 
would have been motivated to modify the alleged admitted prior art as ai^ued in the last 
paragraph of page 7 in the Examiner's Answer. In addition, it is not at all clear as to which 
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illumination estimation the Examiner is referring in ihat paragraph. For at least this reason, 
the rejection of Claim 14 is confusing and improper and should thus be withdrawn. 

The Examiner has now argued that the alleged admitted prior art discloses all the 
features of Claim 14, However, the Examiner also relics upon the disclosure contained in 
Sakatani et al. In addition, although the Examiner agrees that Lhc alleged admitted prior art 
fails to disclose that the up-sampling module 34 performs an interpolation using the original 
image as a guide, the Examiner still rejected Claims 14 and 15 as if the up-sampling module 
34 uses the original image as a guide in the interpolation. (See, Examiner's Answer, page 6, 
lines 12-14). Again, the rejection is unclear and should be withdrawn. 

in any regard, the rejection of Claims 1 4 and 1 5 is clearly improper for at least the 
reasons presented above with respect to Claims 1-3, and 23. More particularly, for instance, 
the alleged admitted prior art tails to at least disclose that an interim illumination estimation 
is generated for each of one or more low resolution images, and generating an illumination 
estimation suitable for Retincx-type correction by up-sampling the interim illumination 
estimations by combining the input image and the interim illumination estimations. 
In addition, Salcatani et al. foils to make up for the deficiencies in the alleged admitted prior 
ait For instance, paragraph 1 1 S of Sakatani et aL recites that the resolution of the original 
and blurred images are matched with each other to execute a Single Scale Retinex 
calculation, which indicates that the resolution of a blurred image is changed to match the 
resolution of an original image by interpolation. As such, Sakatani et al. discloses that the 
resolutions of images are matched with each other and thus docs not disclose that interim 
illumination estimations are interpolated to produce an illumination estimation by using an 
input image as a guide in the interpolation. For at least the foregoing reasons, the proposed 
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combination of the alleged admitted prior art and Sakotani et al. foils to disclose al] of the 
features of independent Claim 14. 

For at least the foregoing reasons, it is respectfully submitted that the proposed 
combination of Kimmcl ct al., the alleged admitted prior art, and Sakatani et al, foils to 
disclose each and every clement claimed in Claims 14 and 15 of the present invention. 
Accordingly, assuming only for the sake of argument that one of ordinary skill in the art were 
somehow motivated to combine these disclosures as suggested by the Examiner, the proposed 
combination would foil to disclose all of the features of the claimed invention. Clearly, 
therefore, the proposed combination foils to teach or suggest all of the claimed elements, and 
thus, the Examiner has failed to establish a prima facie case of obviousness based upon these 
documents. 
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TV. Conclusion 

For at least the reasons given above, the rejections of Claims 1-3, 14, IS, and 23 are 
improper. The Appellant therefore respectfully requests that the Board of Patent Appeals and 
Interferences reverse die Examiner's decision rejecting Claims 1-3, 14, 15, and 23 and to 
direct the Examiner to pass the case to issue. 

Respectfully submitted, 



Dated: August 1 1, 2008 




Timothy B.Kang 
Registration No.: 46,423 



MANNAVA & KANG, P.C. 
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(703) 652-3817 

(703) 865-5150 (facsimile) 
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